Augmented reality-assisted method for performing surgery

ABSTRACT

An augmented reality-assisted method for performing surgery comprises: disposing a position sensing element at a facial positioning point of a patient before craniotomy to obtain skull space and intracranial space information for defining a coordinate space; obtaining a brain anatomical image for constructing a three-dimensional graphic, the graphic comprising a graphic positioning point and a feature associated with a gyrus feature; defining a relative positional relationship between the graphic and the space, aligning the facial positioning point with the graphic positioning point; using a probe to obtain a spatial position of the gyrus feature after craniotomy, using the gyrus feature as a calibration reference point; generating a displacement and rotation parameter based on a coordinate difference of the feature relative to the reference point; adjusting a position and/or an angle of the graphic on a display according to the parameter, and the display displaying the calibrated three-dimensional graphic.

FIELD OF THE INVENTION

The invention relates to a computer-assisted method for performingsurgery, and more particularly to an augmented reality-assisted methodfor performing surgery.

BACKGROUND OF THE INVENTION

Craniotomy often causes brain shift after skull opening, and possiblecauses include physical, surgical, and biological factors. Physicalfactors such as the patient's posture and gravity during the surgicaloperation; surgical factors such as the surgical equipment used (e.g.tractor) and loss of body fluids and brain tissues during surgery; andbiological factors such as tumor type, location, and drugs used duringsurgery.

In craniotomy operations, preoperative nuclear magnetic resonance imagesare generally used in conjunction with surgical navigation system toguide the operation. However, when a brain shift occurs, the surgicalnavigation reference image becomes no longer accurate, thus increasingthe difficulty for doctors to perform the operation.

SUMMARY OF THE INVENTION

The invention provides an augmented reality-assisted method forperforming surgery, which is capable of solving the problem of mismatchbetween the brain in surgery and preoperative images due to brain shiftduring craniotomy.

In order to achieve the above-mentioned object, the invention providesan augmented reality-assisted method for performing surgery, comprisingfollowing steps of: step 1: disposing a position sensing element at afacial positioning point of a target patient to obtain a skull spaceinformation and an intracranial space information of the target patientbefore craniotomy, and defining a coordinate space according to theskull space information and the intracranial space information; step 2:obtaining a brain anatomical image of the target patient beforecraniotomy and constructing a three-dimensional graphic based on thebrain anatomical image, the three-dimensional graphic comprising agraphic positioning point associated with the facial positioning pointof the target patient and a feature associated with a gyms feature ofthe target patient; step 3: defining a relative positional relationshipbetween the three-dimensional graphic and the coordinate space, aligningthe facial positioning point with the graphic positioning point of thethree-dimensional graphic, and displaying an aligned three-dimensionalgraphic on a display of an augmented reality device; step 4: using aprobe to obtain a spatial position of the gyms feature of the targetpatient in the coordinate space after craniotomy, using the gyms featureas a calibration reference point; step 5: generating a displacement androtation parameter based on a coordinate difference of the feature ofthe three-dimensional graphic relative to the calibration referencepoint; and step 6: adjusting a position and/or an angle of thethree-dimensional graphic on the display according to the displacementand rotation parameter, so that the display displaying the calibratedthree-dimensional graphic.

In order to achieve the above-mentioned object, the invention furtherprovides an augmented reality-assisted method for performing surgery,comprising following steps of: step 1: disposing a position sensingelement at a facial positioning point of a target patient to obtain askull and intracranial space information of the target patient beforecraniotomy, and defining a coordinate space according to the skull andintracranial space information; step 2: obtaining a brain anatomicalimage of the target patient before craniotomy and constructing athree-dimensional graphic based on the brain anatomical image, thethree-dimensional graphic comprising a graphic positioning pointassociated with the facial positioning point of the target patient and afeature associated with a gyrus feature of the target patient; step 3:defining a relative positional relationship between thethree-dimensional graphic and the coordinate space, aligning the facialpositioning point with the graphic positioning point of thethree-dimensional graphic, and displaying an aligned three-dimensionalgraphic on a display of an augmented reality device; step 4: capturing abrain image of the target patient after craniotomy to generate a gymsimage, displaying the gyms image on the display, the gyms imagecomprising a gyms feature point, the gyms feature point corresponding tothe gyms feature of the brain of the target patient; step 5: calculatinga coordinate difference between the gyms feature point of the gyrusimage and the feature of the three-dimensional graphic to generate adisplacement and rotation parameter; and step 6: adjusting a positionand/or an angle of the three-dimensional graphic on the displayaccording to the displacement and rotation parameter, thus displayingthe feature of the three-dimensional graphic superimposed on the gymsfeature point of the gyrus image on the display.

In order to achieve the above-mentioned object, the invention furtherprovides an augmented reality-assisted method for performing surgery,comprising following steps of: step 1: disposing a position sensingelement at a facial positioning point of a target patient to obtain askull and intracranial space information of the target patient beforecraniotomy, and defining a coordinate space according to the skull andintracranial space information; step 2: obtaining a brain anatomicalimage of the target patient before craniotomy and constructing athree-dimensional graphic based on the brain anatomical image, thethree-dimensional graphic comprising a graphic positioning pointassociated with the facial positioning point of the target patient and afeature associated with a gyrus feature of the target patient; step 3:defining a relative positional relationship between thethree-dimensional graphic and the coordinate space, aligning the facialpositioning point with the graphic positioning point of thethree-dimensional graphic, and displaying an aligned three-dimensionalgraphic on a display of an augmented reality device; step 4: capturing abrain image of the target patient after craniotomy to generate a gymsimage and a depth image information, displaying the gyms image on thedisplay, the gyms image comprising a gyrus feature point, the gyrusfeature point corresponding to the gyms feature of the brain of thetarget patient; step 5: constructing a first curved grid based on thethree-dimensional graphic, and constructing a second curved grid basedon the gyrus image and the depth image information, the first curvedgrid comprising the feature associated with the gyms feature of thetarget patient, the second curved grid comprising a grid positioningpoint associated with the gyms feature of the target patient; step 6:calculating a difference between the first curved grid and the secondcurved grid and performing an adjustment on the first curved grid, sothat a minimum distance being between the feature of the first curvedgrid and the grid positioning point of the second curved grid; and step7: the display displaying the superimposed gyrus image.

Based on the foregoing, the augmented reality-assisted method forperforming surgery of the invention are capable of adjusting orcalibrating the three-dimensional graphic in real time, so as tocompensate the mismatch between the brain and preoperative images todisplay images more accurately, and the system based on the augmentedreality-assisted method is capable of providing calibrated images inreal time and accurately, and can be used, for example, in supportingmedical treatment, surgery, or operating instruments.

In order to make the above-mentioned features and advantages of theinvention more obvious and comprehensible, the following specificembodiments are described in detail in conjunction with the accompanyingdrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flowchart of a method according to an embodiment of theinvention;

FIG. 2 is a schematic diagram of a system according to an embodiment ofthe invention;

FIG. 3 is a schematic diagram of disposing a position sensing element ata facial positioning point of a target patient according to anembodiment of the invention;

FIG. 4 is a schematic diagram of a coordinate space according to anembodiment of the invention;

FIG. 5 is a brain anatomical image according to an embodiment of theinvention;

FIG. 6 is a schematic diagram of a three-dimensional graphic accordingto an embodiment of the invention;

FIG. 7 is a schematic diagram of graphic positioning points and gyrusfeatures of the target patient according to an embodiment of theinvention;

FIG. 8 is a schematic diagram of the three-dimensional graphic beingplaced in the coordinate space according to an embodiment of theinvention;

FIG. 9 is a schematic diagram of using a probe to detect a brain entityof the target patient according to an embodiment of the invention;

FIG. 10 is a schematic diagram of a display showing thethree-dimensional graphic of the target patient according to anembodiment of the invention;

FIG. 11 is a flowchart of the method according to another embodiment ofthe invention;

FIG. 12 is a flowchart of the method according to yet another embodimentof the invention;

FIG. 13A and FIG. 13B are schematic diagrams of a first curved grid anda second curved grid according to an embodiment of the invention; and

FIG. 14 is a schematic diagram of adjusting the first curved gridaccording to an embodiment of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The foregoing and other technical content, features and efficacies ofthe invention will be clearly presented in the following detaileddescription of the preferred embodiments with reference to the drawings.

Please refer to FIG. 1 and FIG. 2 , FIG. 1 is a flowchart of a methodaccording to an embodiment of the invention; and FIG. 2 is a schematicdiagram of a system according to an embodiment of the invention. Anaugmented reality-assisted system 10 method for performing surgerydepicted in FIG. 2 comprises an augmented reality device 11, and aposition sensing element 12 for applying to a target patient 20. Theaugmented reality device 11 comprises a display 11 a, an image capturingdevice 11 b, and a processing device 11 c. In this embodiment, theposition sensing element 12 is a positioning element used in surgicalnavigation, for example, an electromagnetic induction tracking elementor an optical tracking element.

In this embodiment, a craniotomy for the target patient 20 is taken asan example. A method 100 comprises following steps.

In step S101, referring to FIG. 3 , before performing the craniotomy,disposing the position sensing element 12 on at least one facialpositioning point 21 of the target patient 20 to obtain a skull spaceinformation and an intracranial space information of the target patient20 before the craniotomy. The facial positioning point 21 can be apredetermined specific position on a head of the target patient 20before the craniotomy for performing subsequent information acquisitionoperations. In this embodiment, the facial positioning point 21comprises a first facial positioning point 21 a, a second facialpositioning point 21 b, a third facial positioning point 21 c, and afourth facial positioning point 21 d.

The skull space information can be, for example, information of size,structure, or contour of a skull of the target patient 20, and theintracranial space information can be, for example, information of size,structure, or contour of a cranial cavity of the target patient 20.Then, defining a coordinate space 30 using the processing device 11 cbased on the skull space information and the intracranial spaceinformation, as shown in FIG. 4 . The coordinate space 30 corresponds toan intracranial space of the target patient 20, that is, the facialpositioning point 21 is located at a specific position in the coordinatespace 30.

In step S103, obtaining a brain anatomical image 40 of the targetpatient 20 before the craniotomy, as shown in FIG. 5 . In thisembodiment, the brain anatomical image 40 is Nuclear Magnetic ResonanceImaging (NMRI), while in other embodiments, the brain anatomical image40 can also be an X-ray image or a computed tomography image.Constructing a three-dimensional graphic 40 a using the processingdevice 11 c according to the brain anatomical image 40, as shown in FIG.6 . The three-dimensional graphic 40 a can be regarded as a virtualintracranial three-dimensional model of the skull of the target patient20. According to image features in the three-dimensional graphic 40 a,associating the facial positioning point 21 of the target patient 20with at least one graphic positioning point in the three-dimensionalgraphic 40 a, and associating at least one gyrus feature of the targetpatient 20 with at least one feature in the three-dimensional graphic 40a, as shown in FIG. 7 . In this embodiment, the graphic positioningpoint comprises a first graphic positioning point 41 a, a second graphicpositioning point 41 b, a third graphic positioning point 41 c, and afourth graphic positioning point 41 d, the feature comprises a firstfeature 42 a, a second feature 42 b, a third feature 42 c, and a fourthfeature 42 d. Specifically, the graphic positioning point on thethree-dimensional graphic 40 a can be marked as the facial positioningpoint 21 of the target patient 20, and the feature in thethree-dimensional graphic 40 a can be marked as the gyms feature of thetarget patient 20.

In this embodiment, multi-section nuclear magnetic resonance images aregenerated by NMRI, and then the three-dimensional graphic 40 a isgenerated through a volume rendering.

In step S105, placing the three-dimensional graphic 40 a in thecoordinate space 30, as shown in FIG. 8 , and using the facialpositioning point 21 as a positioning reference. In detail, aligning thefacial positioning point 21 in the coordinate space 30 with the graphicpositioning point of the three-dimensional graphic 40 a, that is, thevirtual three-dimensional model of the target patient 20 is made to usethe coordinate space 30 as a reference coordinate system. And displayingthe aligned three-dimensional graphic 40 a on the display 11 a of theaugmented reality device 11.

In step S107, when performing a surgical operation and during acraniotomy, using a probe 50 to detect a brain entity of the targetpatient 20, as shown in FIG. 9 . Obtaining a position of the gymsfeature of the brain of the target patient 20 during the surgicaloperation. In one example, the gyms feature comprises a first gymsfeature 22 a, a second gyms feature 22 b, a third gyms feature 22 c, anda fourth gyms feature 22 d. Obtaining a spatial position of the gyrusfeature in a preset coordinate system, the preset coordinate system canbe defined based on the probe 50, and then converting the presetcoordinate system into the coordinate space 30 to obtain a position ofthe gyrus feature in the coordinate space 30. Wherein, the gyms featureis defined as a calibration reference point.

In step S109, due to factors of loss of cerebrospinal fluid, changes inintracranial pressure or gravity in the craniotomy (i.e. aftertemporarily removing bone from the skull to access the brain), the brainwill be displaced and deformed after the craniotomy compared to beforethe craniotomy. Therefore, there is a spatial mismatch between the gymsfeature of the brain during surgery of the target patient 20 and thefeature of the three-dimensional graphic 40 a. In order to compensatethe mismatch, a displacement and rotation parameter is generated basedon a coordinate difference of the feature of the three-dimensionalgraphic 40 a relative to the calibration reference point in space. Thefeature represents the graphic positioning point of thethree-dimensional graphic 40 a associated with the gyrus feature of thetarget patient 20, and the calibration reference point is the spatialposition of the gyms feature of the target patient 20 in the craniotomyobtained through the probe 50. The displacement and rotation parametergenerated through the coordinate difference comprises a coordinatedifference between the feature and the calibration reference point.Thereby, the coordinate difference between the feature and thecalibration reference point can be calculated for using in subsequentpositioning calibration of the three-dimensional graphic 40 a.

In step S111, adjusting a position and/or an angle of thethree-dimensional graphic 40 a on the display 11 a according to thedisplacement and rotation parameter, so that the display 11 a displayingthe calibrated three-dimensional graphic 40 a, as shown in FIG. 10 , aschematic diagram showing differences before and after calibration,wherein, D_(a) represents a coordinate difference between the firstgyrus feature 22 a and the first feature 42 a; D_(b) represents acoordinate difference between the second gyms feature 22 b and thesecond feature 42 b; D_(c) represents a coordinate difference betweenthe third gyrus feature 22 c and the third feature 42 c; and D_(d)represents a coordinate difference between the fourth gyrus feature 22 dand the fourth feature 42 d. Thereby, during a medical treatmentoperation, the system 10 is capable of calibrating the three-dimensionalgraphic 40 a in real time, so that the display 11 a is capable ofdisplaying calibrated images.

Please refer to FIG. 11 for a flowchart of a method according to anotherembodiment of the invention. In a method 200 of this embodiment, stepsS201 to S205 are the same as the aforementioned steps S101 to S105. Inthis embodiment, performing step S207 after step S205, when performing asurgical operation and during a craniotomy, using an imaging instrumentto capture a brain image of the target patient 20 in the craniotomy, thebrain image comprises a gyms image, and the imaging instrument, forexample, can be a microscope for surgical operation (operatingmicroscope or surgical microscope). Thereby, obtaining a position of thegyms feature of the brain of the target patient 20 during the surgicaloperation. In one example, obtaining a spatial position of the gymsfeature in a preset coordinate system, the preset coordinate system canbe defined based on the imaging instrument, and then converting thepreset coordinate system into the coordinate space 30 to obtain aposition of the gyrus feature in the coordinate space 30. Wherein, thegyms feature is defined as a calibration reference point.

The gyms image is displayed on the display 11 a. Thereby, a user iscapable of seeing the gyms image captured by the image capturing device11 b on the display 11 a. In this embodiment, the gyrus image comprisesa gyrus feature point, and the gyms feature point corresponds to thegyrus feature of the brain of the target patient 20.

In step S209, calculating a coordinate difference between the gyrusfeature point of the gyrus image and the feature of thethree-dimensional graphic 40 a to generate a displacement and rotationparameter. The feature represents the graphic positioning point of thethree-dimensional graphic 40 a associated with the gyrus feature of thetarget patient 20, and the gyrus feature point is a feature point of thegyms image of the target patient 20 in the craniotomy captured throughthe image capturing device 11 b. The displacement and rotation parametergenerated through the coordinate difference comprises a coordinatedifference between the feature and the gyms feature point. Thereby, thecoordinate difference between the feature and the gyrus feature pointcan be calculated for using in subsequent positioning calibration of thethree-dimensional graphic 40 a.

Then, proceeding to step S211, adjusting a position and/or an angle ofthe three-dimensional graphic 40 a on the display 11 a according to thedisplacement and rotation parameter, thus displaying the feature of thethree-dimensional graphic 40 a superimposed on the gyms feature point ofthe gyrus image on the display 11 a. The aforementioned various sensing,control and/or calculations can be implemented by the processing device11 c. Thereby, during a medical treatment operation, the system 10 iscapable of calibrating the three-dimensional graphic 40 a in real time,so that the display 11 a is capable of displaying calibrated images.

Please refer to FIG. 12 for a flowchart of a method according to yetanother embodiment of the invention. In a method 300 of this embodiment,steps S301 to S305 are the same as the aforementioned steps S101 toS105. In this embodiment, performing step S307 after step S305, afterperforming a craniotomy on the target patient 20 during a surgicaloperation, capturing a brain image of the target patient 20 in thecraniotomy to generate a gyms image and a depth image information.

In this embodiment, capturing of the brain image can be realized by, forexample, a multi-camera reconstruction technique; or capturing of thebrain image can be realized by, for example, a depth camera composed ofa camera and an infrared camera; or capturing of the brain image can berealized by, for example, using a camera-projector system withstructured light projection-reconstruction. Thereby, the depth imageinformation included in the captured brain image can have gyms depthinformation.

The gyms image is displayed on the display 11 a of the augmented realitydevice 11. Thereby, the user is capable of seeing the gyms imagecaptured by the image capturing device 11 b on the display 11 a. In thisembodiment, the gyms image comprises a gyrus feature point, and the gymsfeature point corresponds to the gyms feature of the brain of the targetpatient 20.

Then, referring to FIG. 13A and FIG. 13B, in step S309, constructing afirst curved grid 50 a based on the three-dimensional graphic 40 a, andconstructing a second curved grid 50 b based on the gyms image and thedepth image information, the first curved grid 50 a comprising thefeature associated with the gyrus feature of the target patient 20, andthe second curved grid 50 b comprising a grid positioning pointassociated with the gyms feature of the target patient 20.

Then, referring to FIG. 14 , in step S311, calculating a differencebetween the first curved grid 50 a and the second curved grid 50 b andperforming an adjustment on the first curved grid 50 a, so that aminimum distance being between the feature of the first curved grid 50 aand the grid positioning point of the second curved grid 50 b. That is,calibrating the three-dimensional graphic 40 a through the feature andthe grid positioning point.

In detail, the feature represents the graphic positioning point of thethree-dimensional graphic 40 a associated with the gyms feature of thetarget patient 20, and the grid positioning point is the feature pointof the gyrus image of the target patient 20 in the craniotomy capturedthrough the image capturing device 11 b. Thereby, the difference betweenthe feature and the grid positioning point can be calculated for usingin subsequent positioning calibration of the three-dimensional graphic40 a.

Then, in step S313, the display 11 a displaying the superimposed gyrusimage. The aforementioned various sensing, control and/or calculationscan be implemented by the processing device 11 c. Thereby, during amedical treatment operation, the system 10 is capable of calibrating thethree-dimensional graphic 40 a and the gyrus image in real time, so thatthe display 11 a is capable of displaying calibrated images.

In addition, the system 10 can further comprise a physical workpiece,and the three-dimensional graphic 40 a can further comprise a workpiecegraphic. The workpiece graphic is a three-dimensional graphiccorresponding to the workpiece in the three-dimensional graphic 40 a,and medical treatment operations can be aided through the workpiecegraphic. For example, the system 10 is capable of pre-displaying aposition of the workpiece graphic on the display 11 a to indicatepossible subsequent medical treatment procedure and provide medicalpersonnel for reference.

In addition, the workpiece can comprise position sensing elements, theposition sensing elements are capable of providing position, direction,and angle information in space. The processing device 11 c is capable ofgenerating the workpiece graphic according to position signals generatedby the position sensing elements. The position sensing elements can berealized by any possible positioning and displacement sensors. In oneembodiment, the workpiece is illustrated with a scalpel as an example,but the invention is not limited thereto, nor does it limit a number ofthe workpiece. In other embodiments of the invention, the workpiece cancomprise, for example, at least one feature point, and the system 10generates the workpiece graphic through the feature point of theworkpiece. The operating principle and details of the feature point ofthe workpiece can be similar to those of the aforementioned gyms featureof the target patient 20, and thus will not be repeated herein.

In this embodiment, the three-dimensional graphic 40 a can furthercomprise, for example, at least one indicating graphic. For example, theindicating graphic can correspond to a medical treatment procedure toaid in a medical treatment, and disposition of the indicating graphic iscapable of auxiliary in medical treatment operations. For example, theindicating graphic can be provided for indication of a next position ofusing a scalpel in a surgical operation.

In summary, the augmented reality-assisted method for performing surgeryof the invention uses the displacement and rotation parameter obtainedin the craniotomy to adjust the three-dimensional graphic displayed onthe display of the augmented reality device, so that thethree-dimensional graphic and the feature of brain of the target patientare aligned with each other to ensure that the three-dimensional graphicon the display matches with the brain of the target patient; or adjustthe difference between the first curved grid constructed based on thethree-dimensional graphic and the second curved grid constructed basedon the gyms image and the depth image information in order to allowdoctors to be capable of accurately pinpointing the symptoms. Therefore,calibrated images can be provided in real time and accurately for usingin supporting medical treatment, surgery, or operating instruments.

Note that the specification relating to the above embodiments should beconstrued as exemplary rather than as limitative of the presentinvention, with many variations and modifications being readilyattainable by a person of average skill in the art without departingfrom the spirit or scope thereof as defined by the appended claims andtheir legal equivalents.

What is claimed is:
 1. An augmented reality-assisted method forperforming surgery comprising following steps of: step 1: disposing aposition sensing element at a facial positioning point of a targetpatient to obtain a skull space information and an intracranial spaceinformation of the target patient before craniotomy, and defining acoordinate space according to the skull space information and theintracranial space information; step 2: obtaining a brain anatomicalimage of the target patient before craniotomy and constructing athree-dimensional graphic based on the brain anatomical image, thethree-dimensional graphic comprising a graphic positioning pointassociated with the facial positioning point of the target patient and afeature associated with a gyrus feature of the target patient; step 3:placing the three-dimensional graphic in the coordinate space, aligningthe facial positioning point with the graphic positioning point of thethree-dimensional graphic, and displaying an aligned three-dimensionalgraphic on a display of an augmented reality device; step 4: using aprobe to obtain a spatial position of the gyms feature of the targetpatient in the coordinate space after craniotomy, using the gyms featureas a calibration reference point; step 5: generating a displacement androtation parameter based on a coordinate difference of the feature ofthe three-dimensional graphic relative to the calibration referencepoint; and step 6: adjusting a position and/or an angle of thethree-dimensional graphic on the display according to the displacementand rotation parameter, so that the display displaying thethree-dimensional graphic which is calibrated.
 2. The method as claimedin claim 1, wherein the three-dimensional graphic is generated from aplurality of multi-section nuclear magnetic resonance images through avolume rendering, and the multi-section nuclear magnetic resonanceimages are generated by a nuclear magnetic resonance imaging (NMRI)device that detects a target object.
 3. The method as claimed in claim1, wherein the three-dimensional graphic further comprises a workpiecegraphic, the workpiece graphic corresponds to a workpiece, the workpiececomprises at least one position sensing element, and a processing devicegenerates the workpiece graphic according to at least one positionsignal generated by the at least one position sensing element.
 4. Themethod as claimed in claim 1, wherein the three-dimensional graphicfurther comprises at least one indicating graphic, and the indicatinggraphic corresponds to a medical treatment procedure.
 5. An augmentedreality-assisted method for performing surgery, comprising followingsteps of: step 1: disposing a position sensing element at a facialpositioning point of a target patient to obtain a skull and intracranialspace information of the target patient before craniotomy, and defininga coordinate space according to the skull and intracranial spaceinformation; step 2: obtaining a brain anatomical image of the targetpatient before craniotomy and constructing a three-dimensional graphicbased on the brain anatomical image, the three-dimensional graphiccomprising a graphic positioning point associated with the facialpositioning point of the target patient and a feature associated with agyrus feature of the target patient; step 3: defining a relativepositional relationship between the three-dimensional graphic and thecoordinate space, aligning the facial positioning point with the graphicpositioning point of the three-dimensional graphic, and displaying analigned three-dimensional graphic on a display of an augmented realitydevice; step 4: capturing a brain image of the target patient aftercraniotomy to generate a gyrus image, displaying the gyms image on thedisplay, the gyms image comprising a gyms feature point, the gymsfeature point corresponding to the gyms feature of the brain of thetarget patient; step 5: calculating a coordinate difference between thegyrus feature point of the gyms image and the feature of thethree-dimensional graphic to generate a displacement and rotationparameter; and step 6: adjusting a position and/or an angle of thethree-dimensional graphic on the display according to the displacementand rotation parameter, thus displaying the feature of thethree-dimensional graphic superimposed on the gyms feature point of thegyms image on the display.
 6. The method as claimed in claim 5, whereinthe three-dimensional graphic is generated from a plurality ofmulti-section nuclear magnetic resonance images through a volumerendering, and the multi-section nuclear magnetic resonance images aregenerated by a nuclear magnetic resonance imaging (NMRI) device thatdetects a target object.
 7. The method as claimed in claim 5, whereinthe three-dimensional graphic further comprises a workpiece graphic, theworkpiece graphic corresponds to a workpiece, the workpiece comprises atleast one position sensing element, and a processing device generatesthe workpiece graphic according to at least one position signalgenerated by the at least one position sensing element.
 8. The method asclaimed in claim 5, wherein the three-dimensional graphic furthercomprises at least one indicating graphic, and the indicating graphiccorresponds to a medical treatment procedure.
 9. An augmentedreality-assisted method for performing surgery, comprising followingsteps of: step 1: disposing a position sensing element at a facialpositioning point of a target patient to obtain a skull and intracranialspace information of the target patient before craniotomy, and defininga coordinate space according to the skull and intracranial spaceinformation; step 2: obtaining a brain anatomical image of the targetpatient before craniotomy and constructing a three-dimensional graphicbased on the brain anatomical image, the three-dimensional graphiccomprising a graphic positioning point associated with the facialpositioning point of the target patient and a feature associated with agyrus feature of the target patient; step 3: defining a relativepositional relationship between the three-dimensional graphic and thecoordinate space, aligning the facial positioning point with the graphicpositioning point of the three-dimensional graphic, and displaying analigned three-dimensional graphic on a display of an augmented realitydevice; step 4: capturing a brain image of the target patient aftercraniotomy to generate a gyrus image and a depth image information,displaying the gyms image on the display, the gyms image comprising agyms feature point, the gyrus feature point corresponding to the gyrusfeature of the brain of the target patient; step 5: constructing a firstcurved grid based on the three-dimensional graphic, and constructing asecond curved grid based on the gyrus image and the depth imageinformation, the first curved grid comprising the feature associatedwith the gyms feature of the target patient, the second curved gridcomprising a grid positioning point associated with the gyms feature ofthe target patient; step 6: calculating a difference between the firstcurved grid and the second curved grid and performing an adjustment onthe first curved grid, so that a minimum distance being between thefeature of the first curved grid and the grid positioning point of thesecond curved grid; and step 7: displaying the gyrus image which issuperimposed on the display.
 10. The method as claimed in claim 9,wherein the three-dimensional graphic is generated from a plurality ofmulti-section nuclear magnetic resonance images through a volumerendering, and the multi-section nuclear magnetic resonance images aregenerated by a nuclear magnetic resonance imaging (NMRI) device thatdetects a target object.
 11. The method as claimed in claim 9, whereinthe three-dimensional graphic further comprises a workpiece graphic, theworkpiece graphic corresponds to a workpiece, the workpiece comprises atleast one position sensing element, and a processing device generatesthe workpiece graphic according to at least one position signalgenerated by the at least one position sensing element.
 12. The methodas claimed in claim 9, wherein the three-dimensional graphic furthercomprises at least one indicating graphic, and the indicating graphiccorresponds to a medical treatment procedure.